A Barzilai-Borwein descent method for multiobjective optimization problems
نویسندگان
چکیده
The steepest descent method proposed by Fliege and Svaiter has motivated the research on methods for multiobjective optimization, which received increasing attention in recent years. However, empirical results show that Armijo line search often a very small stepsize along direction, decelerates convergence seriously. This paper points out issue is mainly due to imbalances among objective functions. To address this issue, we propose Barzilai-Borwein optimization (BBDMO), dynamically tunes gradient magnitudes using Barzilai-Borwein’s rule direction-finding subproblem. We emphasize BBDMO produces sequence of new directions compared Morovati et al. With monotone nonmonotone techniques, prove accumulation generated are Pareto critical points, respectively. Furthermore, theoretical indicate can achieve better BBDMO. Finally, comparative numerical experiments reported illustrate efficiency verify results.
منابع مشابه
Relaxed Steepest Descent and Cauchy-Barzilai-Borwein Method
The negative gradient direction to find local minimizers has been associated with the classical steepest descent method which behaves poorly except for very well conditioned problems. We stress out that the poor behavior of the steepest descent methods is due to the optimal Cauchy choice of steplength and not to the choice of the search direction. We discuss over and under relaxation of the opt...
متن کاملInexact Barzilai-Borwein method for saddle point problems
This paper considers the inexact Barzilai-Borwein algorithm applied to saddle point problems. To this aim, we study the convergence properties of the inexact Barzilai-Borwein algorithm for symmetric positive definite linear systems. Suppose that gk and g̃k are the exact residual and its approximation of the linear system at the k-th iteration, respectively. We prove the R-linear convergence of t...
متن کاملThe cyclic Barzilai–Borwein method for unconstrained optimization
In the cyclic Barzilai–Borwein (CBB) method, the same Barzilai–Borwein (BB) stepsize is reused for m consecutive iterations. It is proved that CBB is locally linearly convergent at a local minimizer with positive definite Hessian. Numerical evidence indicates that when m > n/2 3, where n is the problem dimension, CBB is locally superlinearly convergent. In the special case m = 3 and n = 2, it i...
متن کاملQuadratic regularization projected alternating Barzilai–Borwein method for constrained optimization
In this paper, based on the regularization techniques and projected gradient strategies, we present a quadratic regularization projected alternating Barzilai–Borwein (QRPABB) method for minimizing differentiable functions on closed convex sets. We show the convergence of the QRPABB method to a constrained stationary point for a nonmonotone line search. When the objective function is convex, we ...
متن کاملBarzilai-Borwein Step Size for Stochastic Gradient Descent
One of the major issues in stochastic gradient descent (SGD) methods is how to choose an appropriate step size while running the algorithm. Since the traditional line search technique does not apply for stochastic optimization algorithms, the common practice in SGD is either to use a diminishing step size, or to tune a fixed step size by hand. Apparently, these two approaches can be time consum...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: European Journal of Operational Research
سال: 2023
ISSN: ['1872-6860', '0377-2217']
DOI: https://doi.org/10.1016/j.ejor.2023.04.022